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SECURITY CQfJTRn L SYSTEM 
TECHNICAT. TTV^j^p 

The present invention relates to a control system for 
use with a security door, with interlocking or synchronised 
5 doors, or with other means, such as turnstiles, flaps or 
other obstacles, for controlling access to a secured area. 

A typical security door may comprise a revolving door 
divided into, say, four compartments by radially extending 
wings. The wings are coupled centrally at their upper or 

10 lower end to an interlock operated by a control system and 
are typically motor driven, but may alternatively be pushed 
manually. Turnstile systems are generally free to be 
pushed manually. 

The control system may operate, for example, in 

15 response to a card reader. An authorised person wishing to 
pass through the door will then insert their pass card in 
the reader and, provided that their card is recognised, the 
control system then operates the interlock to free the 
revolving door so the user can pass through it. If the 

20 card is not recognised, or if an unauthorised person 
attempts to gain access without use of the pass card 
reader, then the interlock holds the wings of the revolving 
door against movement and so prevents passage through the 
door. 

25 BACKGROUND APy 

Known security doors suffer from a number of potential 
forms of misuse. In particular they are vulnerable to 
"piggy-backing" in which two individuals attempt to pass 
through the door in one compartment, or "tail-gating" in 

30 which an unauthorised person enters the compartment 
immediately following the one containing the authorised 
person, or passes through the door in the opposite 
direction. It has previously been proposed to use 
pressure-sensitive door mats in. the security door, or to 

35 use ultra-sonic sensors to detect the presence of more than 
one person in the door. However these measures have not 
been wholly successful and there remains a need for a 
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security system capable of detecting reliably piggy-backing 
or tan-gating, whilst providing ease of use and only a 
minimum number of false alarms. 

SUMMARY np THP i^ t^ESENT rmrv^j rr... 

5 . According to a first aspect of the present invention 
a control system suitable for use with a security access 
device such as a security door comprises a video input 
device Which in use captures visual image data from the 
secured region of the device, an image processor for 

10 processing said image data and deriving at least one 
parameter for discriminating the number of persons present 
m the secured area of the device and a comparator for 
comparing the said parameter derived from the original data 
with a predetermined threshold and producing a 

15 discriminatory output for use in controlling the interlock 
on the security device depending upon the result of the 
comparison. 

The present inventors have adopted an entirely new 
20 brr^'^f'' ^-tsation Of tail-gating and piggy-backing, 
20 based on the use of video data. While the use of video 
data has previously been proposed for the recognition of 
authorised persons, as an alternative, e.g., to the use of 

ZZJ^'^T "^^^ °' Piggy-backing 

detection (APB) has not previously been thought desirable 

25 or possible. On the face of it the complexity of the 
visual data which would be gathered from e.g., a revolving 
transparent door, and the processing overheads involved in 
determining from such data the number of persons present 
provide a major disincentive to the adoption of such 

30 techniques. By contrast with recognition techniques which 
take place outside the door, APB detection generally has to 
be carried out in the short interval of time during which 
the user is passing through the door and so techniques 
involving large processing overheads tend to be avoided 

15 However, the present inventors have realised that with 
appropriate processing, the raw video data can be used to 
yield a simple parameter for comparison with a 
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predetermined threshold, and that the use of video data in 
this manner allows effective APB detection in real time 
using a relatively low-powered processor. The threshold 
may be for a statistic derived from a number of parameters 
5 xn combination. 

Preferably the image processor and discriminator 
comprxse a cascaded series of modules, each module being 
arranged to process image data to determine a respective 
parameter, and to compare the parameter with a 
10 corresponding threshold. 

Preferably the modules are arranged so that when one 
module is able to make a decision at a predetermined 
confidence level, then that module produces the said 
discriminatory output signal, otherwise the said module 
15 passing image data on to a subsequent module for further 
processing. 

Preferably the modules are arranged generally in order 
Of their discriminatory power, with the most powerful 
nodule receiving the image data first, 
to The discriminatory power of a module is a measure of 

Its ability to make a discriminatory decision with a 
minimum processing overhead, and so at maximum speed. The 
efficiency of the whole system is maximised by using the 
fastest tests firsts, and only passing on to tests with a 
5 greater processing overhead when the preceding tests fail 
to meet a predetermined confidence level. 

Preferably the image processor is arranged to capture 
a background image of the door with no person present, and 
to capture a subsequent image of the door with a person 
0 present and to discard from the second said image video 
data Which is unchanged from the background image. 

According to a second aspect of the present invention 
there is provided a method of controlling a security access 
device, such as a security door, including capturing video 
> image data from a secured area of the access device 
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5 



processing said i„age data and thereby deriving at 
least one parameter for discriminating the number of 
persons present in the secured area, and 

5 threshirr'r T ''""'"^^ ^ predetermined 

5 threshold and producing a discriminatory output for use in 

controlling an interlock on the security device to lock the 
device When more than a predetermined number of persons are 
present in the secured area. 

The present invention also encompasses a security 
10 access devic. when fitted with a control syste. i' 
accordance with the first aspect of the present invention. 

According to a further aspect of the present 
invention, there is provided a security access device 
including a secured region bounded by one or more wholly or 
15 partially transparent walls, characterised by a control 
system including a video input device arranged to view the 
secured region, and in that the transparent walls include 
filter means arranged to block or reduce the transmission 
Of light in part of the visible/near-visible optical 
20 spectrum, and in that the video input device has a 
sensitivity/wavelength characteristic generally 
complementary to the transmission characteristic of the 
said filter means associated with the transparent walls, 
the visibility to the video input device of objects outside 
25 the transparent walls thereby being reduced or eliminated 

^u^.J'T.t'''? ''"^''^ —only 
built With glass doors, objects outside the secured area 

are therefore potentially visible to any video security 

control system and may "confuse" any judgement made by the 

0 control system. This aspect of the present invention 

overcomes this problem by using walls which are transparent 

m one part of the visible/near-visible spectrum and a 

video input device which is sensitive in another part of 

the spectrum. The walls may, for example, be covered by a 

film Which blocks transmission in the infra-red. The video 

device may either be selected to be inherently sensitive in 

the infra-red range, and insensitive outside that range 
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or. 



may be provided with an input filter giving this 
desired sensitivity/wavelength characteristic. 

fiR?:EF DESCFTPTION OF thp; hpautm^^ 

Figure l is a block diagram of a system embodying the 
5 present invention; 

Figures 2a and 2b are schematic representations of 
captured video data at different stages of processing; 

Figure 3 shows a set of pixel masks used in processing 
the image data to detect the head edges shown in Figure 2b. 
10 Figure 4 is a schematic illustrating the processing of 

the image data to derive the image height and width; 

Figure 5 is a flow diagram for the image processing in 
the APB control circuit; 

Figure 6 is a schematic of hardware for implementing 
15. the system of Figure l; and 

Figures 7a - 7d are graphs showing experimental data 
obtained using the system of Figure i. 

DETATLFn DESgRTPTT n^ 

An entry control system comprises a revolving door 1 
20 Which, in this example, has four compartments defined by 
radially extending wings 2a-2d. The movement of the wings 
IS controlled by an interlock 3 mounted centrally above the 
wings. This interlock operates in a fashion conventional 
in revolving security doors to lock the door against 
25 movement until an appropriate control . signal is received 
from a control unit. 

A card reader 5 is connected to the door controller 4 
and stands outside the door 1. i„ use, when someone wishes 
to pass through the door, that person inserts their card in 

30 the reader 5. Provided that the card is recognised, the 
reader 5 outputs an authorization signal to the door 
controller 4 which then operates the interlock 3 to free 
the door Which is then driven by a motor through an angle 
sufficient for the authorised user to pass from the 

35 entrance to the exit of the door. 

such security door systems are vulnerable to misuse if 
there is piggy-backing, that is to say if a second 
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unauthorised person enters the compartment together with 
the authorised person, or if there is tail-gating, in which 
the unauthorised person passes through the door in another 
of the compartments at the same time as the authorised 
5 person goes through. In the present example, the control 
system for the door further comprises a video camera 6 
which is mounted above the door looking down into an 
underlying compartment. The video data from the camera is 
processed in an APB control circuit 7 to produce a 
10 discriminatory output which goes to the controller 4 for 
the door to operate the interlock 3 to lock the door when 
piggy-backing or tail-gating is detected. 

As illustrated in Figure 5, the APB control circuit 
has a cascaded hierarchical structure. This comprises a 
IS- plurality of stages arranged generally in order of the 
discriminatory power of the particular parameter which is 
derived and used. In use, the image data is first subject 
to processing by the first of this hierarchy of stages. If 
that results in the production of a parameter having a 
20 value such that a decision on the presence or absence of a 
second person can be made with adequate confidence, then 
the processing is terminated, at that stage and an 
appropriate output signal produced and fed to the external 
control unit. If, however, a decision cannot be made based 
25 on the first parameter, then the image data is passed on to 
the next stage in the hierarchy, for further processing and 
the derivation of a further parameter and so on. In this 
way, the system is structured to maximise the processing 
speed and to minimise the average processing overhead for 
30 the image data. Just a single parameter may be used for 
the discrimination in the majority of cases, with further 
parameters being derived and tested only in those marginal 
cases where a single parameter does not enable a decision 
to be made with sufficient confidence. 
35 In the present example, the first stage of the video 

control circuit is a background-subtraction stage. This 
firstly captures a background image of the compartment of 
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the door prior to the entry of the user into the field of 
view of the camera. This background image is stored in 
order to provide a means of identifying changes occurring 
When entry into the door compartment is effected, 
subsequently, as the user passes into the field of view 
the system captures a second image, the "present" image' 
This is compared with the stored background image and those 
pixels which are unchanged are discarded, thereby 
eliminating them from the subsequent processing stages, m 
this example, the comparison is carried out by taking the 
grey scale values in the range 1-255 of each pixel, 
subtracting one from the other and writing a value of 0 for 
each pixel where the result of the subtraction is o or is 
less than a predetermined small value, say 10. where the 
15- difference is greater than this predetermined threshold, 
then the value written is simply the grey scale value of 
the present image for that pixel, m the course of this 
process a count is maintained of the number of non-zero 
pixels produced and this is used as the first test 
20 parameter for APB detection, it is found that when two or 
more persons are present the difference count is 
characteristically higher than when a single person is 
present in the door, m some cases however the result of 
the difference count will be too close to the relevant 
25 predetermined threshold for a reliable determination to be 
made. m this case the video data is passed on for 
subsequent stages of processing and discrimination. 

Referring again to Figure 5, in this example the next 
stage carries out edge detection using the known Sobel edge 
30 detection algorithm. This algorithm is applied only to the 
non-zero pixels of the image output from the first stage 
and sets those pixels to one of two binary values producing 
a binary image with, for example, edges shown in black on 
a white ground as in Figure 2a. a determination is then 
35 made of the area inside the edges. This is done by 
stepping a window of dimensions, e.g., lo x lo through the 
image and recording a count for each pixel which is inside 
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the edges and for which none of the pixels of the Window 
cross an edge. This count then is a measure of the area 
inside the edges and is related to the area in the view of 
the camera of the shoulders and head of the person passing 
5 through the door. This measure of the area provides a 
second discriminatory parameter which as in the first stage 
is compared with a respective discriminatory threshold. As 
before, if this comparison produces a result with a 
sufficient degree of certainty, then the processing can be 
10 terminated at that stage and the discriminatory output 
passed on to the control system 7. if this is not the 
case, then the system passes on to the next stage of 
processing. As illustrated in Figure 4, this calculates 
the height and width of the image defined by the edges, 
15- calculates the ratio of the two, and compares this with a 
respective predetermined threshold. 

In this example the final processing module carries 
out what has been termed "head edge detection". This uses 
the aliasing characteristic of the "corners" of the 
20 detected edges. The image data is compared with a set of 
pixel masks of the form shown in Figure 3. A count is 
incremented, and a mark displayed (Figure 2b), for each 
pixel where a match is found with one of the masks. The 
count of the number of matches is then compared with a 
predetermined threshold for the count to provide a further 
discriminatory test. 

When any of the tests produces an output indicating 
that two or more people are in the door, then the control 
system 7 may activate the -interlock to lock the door 
against movement, thereby trapping the users, or may drive 
the door in the reverse direction to expel the users. 

The inventors have found that the discrimination of 
the system can be improved by calculating an additional 
parameter to compensate for the position of an object in 
35 the door. The parameters discussed above are based on what 
is assumed to be a plan view from above of the person in 
the door. However, if the person is not directly under the 
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camera, then the camera captures part of the side of the 
body too. This extra information would tend to distort the 
measurement and could lead to the mis-classification of a 
tall off-centre person as two people. To avoid this, a 
5 measurement is taken first of the position of the centre 
Of the object. This is then compared with the actual 
centre of the camera and an adjustment parameter is set 
The adjustment parameter takes the form of a ratio by which 
subsequently determined parameters are multiplied. 
10 Figure 7a and Column i of Table i show the 

measurements of the position of the object used for 
determining the adjustment ratio for a sample of 72 test 
images. The higher the number the further the object is 
from the centre of the camera. The images are a selection 
from the following categories: a single person; two peoples- 
people carrying large and small objects; a person carrying 
a large object over their head. 

Figure 7b and Column 2 of the table show the 
difference count parameter, after correction by the 
adjustment ratio or "normalising factor" of Figure 7a. 
Note that images 68-70 are large objects carried over the 
top of the head and so result in a large difference count. 
Figure 7c and Column 3 show the (corrected) head area 
parameter. This measurement is a guide to the total area 
25 available to be a head space. images 68-70 would cause 
concern as the values are extremely high. These images 
would fall above the alarm threshold, as 2 people could fit 
under such a large object. Figure 7d shows the 
height/width ratio parameter measuring the compactness of 
30 the image. The lower the value, the more likely that the 
imaged object is two people. 

Table 1 below lists the data illustrated in these 
graphs. Columns i to 3 are identified above. The data 
contained in the other columns are as follows; 
35 Column 4 Width 

This is the width of the Head Area region. 



20 
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Column 5 Height 

This is the height of the Head Area region. 

Column 6 Normalised Ratio 

5 This is the ratio of the width and height. The Normalising 
Factor is used to adjust the ratio depending on the 
position of the object in respect to the centre of the 
camera. 

10 Column 7 Head Edges 

This measurement is the number of pixel patterns that match 
with a head indicator mask. The greater the number the 
larger the number of head mask matches. 



15 



20 



25 



Column 8 Head Edge Groups 

This is the number of concentrated groups of Head Edges. 
Column 9 Straight Edge Indicator 

This measurement is the number of straight lines found in 
the image. 

Column 10 Volume 

This is the total volume that would encapsulate the object. 

Column 11 Volume Width 

This is the width of volume. 

Column 12 Volume Height 

30 This is the height of volume. 

Column 13 Volume Ratio 

This is the ratio of the volume height and volume width. 

35 Not all of the parameters listed in the table need be 

used in any given implementation of the invention. The 
comparators may be arranged to make an "intelligent" 
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decision based on a number of parameters, rather than 
simply applying a single threshold. The system nay also 
include a knowledge base so that it can judge each 
situation on the measurements of the current image and 
5 knowledge gained about the environment the system is 
working with. . . 

Table 2 lists the subjects" used for the different 
images listed in Table l. 

For the data of this example, the following thresholds 
10 may be used by the comparators for discrimination: 

Normalis ed Diffeyfi nT** 

Below 750 - Allow entry 

Above 15000 - Refuse entry. Suspect door entry 

15 Below 750 - Allow entry 

Above 4506 - Refuse entry. Suspect door entry 
Normalised yyjff 

Above 95 - Allow entry 



20 
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Not all measurements have a pass & fail level. For 
example if the ratio is above 95 then we would allow entry. 
If it is below this level, we use other measurements to 
make a decision. 

The system described above may be modified through the 
use of moving images, that is to say the capturing of a 
series of video frames as the person moves through the 
door. This then produces distinctive ••constants" which may 
be used as the basis for discriminatory parameters in an 
analogous fashion to the process discussed above. 

In systems embodying the invention, some of the 
processing modules may use appropriately trained neural 
networks. These may be trained on the parameters produced 
by other modules. 

Appropriate thresholds for the different parameters 
used by different modules may be obtained by inspection 
from real sample data such as that illustrated in Figures 
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7a-7d, and or from computer modelling of the environment in 
which the system is to be used. 

Figure 6 illustrates one example of hardware embodying 
the system. A camera 61 views the target scene and passes 
5 the acquired image to a frame grabber 62. In this 
preferred implementation, the camera views the target scene 
through an IR bandpass filter. An IR bandstop filter which 
may be in the form of a film applied to the walls of the 
revolving door and which is transparent in the rest of the 
visual spectrum is then used to screen the extraneous 
visual field from the field of view of the camera. A light 
source may be provided inside the door to provide 
illumination at levels appropriate to the sensitivity of 
the video camera 61. 

The image from the frame grabber is passed to a single 
board PC 63 Which runs image processing software 
implementing the hierarchical modular structure discussed 
above. once a decision has been made by the control 
program, an output is passed to the door controller 64. 

In the presently described example, the camera 61 is 
a 1/3 inch black and white EI camera (RS845-184) having a 
1/3 inch CS mount DD lens, 2.6mm (RS846-266) . The frame 
grabber is that available commercially as VIDEOBLASTER SE. 
in this example the single board PC uses an Intel 486DX2/66 
25 microprocessor and an ISA bus. The interface to the door 
controller 64 is a standard PC ISA bus serial card. The 
user interface which enables the user to set adjustable 
parameters for the control program may comprise a keyboard 
or keypad and a VDU or LCD display. 

It will be understood that the above components are 
given by way of example only, and that a number of 
alternative implementations are possible. 

The following appendices list, in appendix A, the 
source code for the image processing/discrimination program 
run on the single board PC 63, and, in appendix B, the 
different eletaents of the program are listed in pseudocode. 
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/* Mayor - Guard - Door Secuirty Program * 



/* Martin Golding ^ 
/* ]n9§ukc. ac.uk « 
/* Written in C using T\irbo Borland C * 



// these include other software needed to run the program 

^include <ctype.h> 

^include <dos.h> 

^include <stdio.h> 

/include <stdlib.h> 

/include <iostream.h> 

/include <ionanip.h> 

/include <conio.h> 

/include <inath»h> 

/include <graphics.h> 

// the size of the images that we use. Can be modified latter to 
speed 

//up opreation 

int const IMAGE_SIZE = 256; 

// these are used to hold the image imformation 
unsigned char ** Imgl; 
unsigned char Img2; 
unsigned char Back; 

// creates space for a new image in memory 
// 

void newlmage (unsigned char * ** i,int size) { 

(*i) =» new unsigned char * [size]; 

for (int x=0;x<si2e;x++) { 

(*i)[x] = new unsigned char(si2e]; 
if (l((*i)[x))) { 
clrscr 0 ; 

cout « "\nlmage Error\n\n"; 

getchO ; 

exit(l); 

} 

} 

} 

// deletes space taken up by an image 
// 

void deletelmage (unsigned char*** i,int size) { 
for (int xaO;x<size;x-i"K) { 

if (((*i)[x])) delete ((*i)[x]); 

delete (*i); 

} 

//********************if****************^**^^^^^^^^^^^^ 
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// displays the image on the screen 

void display (unsigned dhar** ima) / 
int Size = IMAtiE_SI2E; 

for (int y = 0; y < size; y++) 
for (mt X = 0; X < size; x++) 
J putpixel(x,y,nng[y] (x]/16) ; 

// creates all the space for the images required 
void start 0 { 

newlmage(&lmgi,256) ; 
newlmage ( & Img2 ,256); 
^ newlmage (&Back, 256) ; 

deletelinage(filmgi,256) ; 
deletelmage (filmg2 , 256) ; 
^ deleteIaage(&Back,256) ; 

// turns the computer into graphics mode so we can see the image 
void startGraphiesO { 

int errorcode, graphdriver, graphmode; 

if (register£arbgidriver(EGAVGA_driver^far) < o) exit(l); 

graphdriver = VGA; 
graphmode = VGAHI; 

initgraph(&graphdriver, Sgraphmode. " » • 
errorcode = graphresultO; •• i' 

if (errorcode 1= grok) { 

cout << "Cant do graphics. \n" ; 
^ exit(l); 

struct palettetype pal; 
getpalette(&pal) ; 

// create gray scale 

4"^,^ = 0; i < pal. size; i++) 
^ setrgbpalette (pal. colors ti], i*4, i*4, i*4); 

// resets the computer from graphics mode 

void endGraphicsO { 
closegraphO ; 

// use roberts operator to detect a presence of a line 
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